Neural Model Research Articles

Deep Learning for Predicting Progression of Patellofemoral Osteoarthritis Based on Lateral Knee Radiographs, Demographic Data, and Symptomatic Assessments.

In this study, we propose a novel framework that utilizes deep learning and attention mechanisms to predict the radiographic progression of patellofemoral osteoarthritis (PFOA) over a period of 7 years. This study included subjects (1,832 subjects, 3,276 knees) from the baseline of the Multicenter Osteoarthritis Study (MOST). Patellofemoral joint regions of interest were identified using an automated landmark detection tool (BoneFinder) on lateral knee X-rays. An end-to-end deep learning method was developed for predicting PFOA progression based on imaging data in a five-fold cross-validation setting. To evaluate the performance of the models, a set of baselines based on known risk factors were developed and analyzed using gradient boosting machine (GBM). Risk factors included age, sex, body mass index, and Western Ontario and McMaster Universities Arthritis Index score, and the radiographic osteoarthritis stage of the tibiofemoral joint (Kellgren and Lawrence [KL] score). Finally, to increase predictive power, we trained an ensemble model using both imaging and clinical data. Among the individual models, the performance of our deep convolutional neural network attention model achieved the best performance with an area under the receiver operating characteristic curve (AUC) of 0.856 and average precision (AP) of 0.431, slightly outperforming the deep learning approach without attention (AUC = 0.832, AP = 0.4) and the best performing reference GBM model (AUC = 0.767, AP = 0.334). The inclusion of imaging data and clinical variables in an ensemble model allowed statistically more powerful prediction of PFOA progression (AUC = 0.865, AP = 0.447), although the clinical significance of this minor performance gain remains unknown. The spatial attention module improved the predictive performance of the backbone model, and the visual interpretation of attention maps focused on the joint space and the regions where osteophytes typically occur. This study demonstrated the potential of machine learning models to predict the progression of PFOA using imaging and clinical variables. These models could be used to identify patients who are at high risk of progression and prioritize them for new treatments. However, even though the accuracy of the models were excellent in this study using the MOST dataset, they should be still validated using external patient cohorts in the future.

Deep learning with plasma plume image sequences for anomaly detection and prediction of growth kinetics during pulsed laser deposition

Materials synthesis platforms that are designed for autonomous experimentation are capable of collecting multimodal diagnostic data that can be utilized for feedback to optimize material properties. Pulsed laser deposition (PLD) is emerging as a viable autonomous synthesis tool, and so the need arises to develop machine learning (ML) techniques that are capable of extracting information from in situ diagnostics. Here, we demonstrate that intensified-CCD image sequences of the plasma plume generated during PLD can be used for anomaly detection and the prediction of thin film growth kinetics. We develop multi-output (2 + 1)D convolutional neural network regression models that extract deep features from plume dynamics that not only correlate with the measured chamber pressure and incident laser energy, but more importantly, predict parameters of an auto-catalytic film growth model derived from in situ laser reflectivity experiments. Our results demonstrate how ML with in situ plume diagnostics data in PLD can be utilized to maintain deposition conditions in an optimal regime. Further, the predictive capabilities of plume dynamics on the kinetics of film growth or other film properties prior to deposition provides a means for rapid pre-screening of growth conditions for the non-expert, which promises to accelerate materials optimization with PLD.

Effects of local reduction of endogenous α-synuclein using antisense oligonucleotides on the fibril-induced propagation of pathology through the neural network in wild-type mice

In Parkinson's disease and other synucleinopathies, fibrillar forms of α-synuclein (aSyn) are hypothesized to structurally convert and pathologize endogenous aSyn, which then propagates through the neural connections, forming Lewy pathologies and ultimately causing neurodegeneration. Inoculation of mouse-derived aSyn preformed fibrils (PFFs) into the unilateral striatum of wild-type mice causes widespread aSyn pathologies in the brain through the neural network. Here, we used the local injection of antisense oligonucleotides (ASOs) against Snca mRNA to confine the area of endogenous aSyn protein reduction and not to affect the PFFs properties in this model. We then varied the timing and location of ASOs injection to examine their impact on the initiation and propagation of aSyn pathologies in the whole brain and the therapeutic effect using abnormally-phosphorylated aSyn (pSyn) as an indicator. By injecting ASOs before or 0–14 days after the PFFs were inoculated into the same site in the left striatum, the reduction in endogenous aSyn in the striatum leads to the prevention and inhibition of the regional spread of pSyn pathologies to the whole brain including the contralateral right hemisphere. ASO post-injection inhibited extension from neuritic pathologies to somatic ones. Moreover, injection of ASOs into the right striatum prevented the remote regional spread of pSyn pathologies from the left striatum where PFFs were inoculated and no ASO treatment was conducted. This indicated that the reduction in endogenous aSyn protein levels at the propagation destination site can attenuate pSyn pathologies, even if those at the propagation initiation site are not inhibited, which is consistent with the original concept of prion-like propagation that endogenous aSyn is indispensable for this regional spread. Our results demonstrate the importance of recruiting endogenous aSyn in this neural network propagation model and indicate a possible potential for ASO treatment in synucleinopathies.

CNSMolGen: A Bidirectional Recurrent Neural Network-Based Generative Model for De Novo Central Nervous System Drug Design.

Central nervous system (CNS) drugs have had a significant impact on treating a wide range of neurodegenerative and psychiatric disorders. In recent years, deep learning-based generative models have shown great potential for accelerating drug discovery and improving efficacy. However, specific applications of these techniques in CNS drug discovery have not been widely reported. In this study, we developed the CNSMolGen model, which uses a framework of bidirectional recurrent neural networks (Bi-RNNs) for de novo molecular design of CNS drugs. Results showed that the pretrained model was able to generate more than 90% of completely new molecular structures, which possessed the properties of CNS drug molecules and were synthesizable. In addition, transfer learning was performed on small data sets with specific biological activities to evaluate the potential application of the model for CNS drug optimization. Here, we used drugs against the classical CNS disease target serotonin transporter (SERT) as a fine-tuned data set and generated a focused database against the target protein. The potential biological activities of the generated molecules were verified by using the physics-based induced-fit docking study. The success of this model demonstrates its potential in CNS drug design and optimization, which provides a new impetus for future CNS drug development.

Recognizing Sign Language using Machine Learning and Deep Learning Models

Individuals with hearing impairments communicate mostly through sign language. Our goal was to create an American Sign Language recognition dataset and utilize it in a neural network-based machine learning model that can interpret hand gestures and positions into natural language. In our study, we incorporated the SVM, CNN and Resnet-18 models to enhance predictability when interpreting ASL signs through this new dataset, which includes provisions such as lighting and distance limitations. Our research also features comparison results between all the other models implemented under invariant conditions versus those using our proposed CNN model. As demonstrated by its high levels of precision at 95.10% despite changes encountered during testing procedures like varying data sets or scene configurations where losses are minimal (0.545), there exists great potential for future applications in image recognition systems requiring deep learning techniques. Furthermore, these advancements may lead to significant improvements within various fields related explicitly to speech-language therapy sessions designed specifically around helping people overcome challenges associated with deafness while building bridges towards improved social integration opportunities.

ОДНОВИМІРНА ЗГОРТКОВА МОДЕЛЬ НЕЙРОННОЇ МЕРЕЖІ ДЛЯ ОБРОБЛЕННЯ СИГНАЛІВ З АМПЛІТУДНОЮ МОДУЛЯЦІЄЮ БАГАТЬОХ СКЛАДОВИХ

The processing of radio signals using artificial neural networks (ANNs) has great potential for research, which can be explained by the adaptability of ANNs to various transmission conditions and the ability to detect abstract patterns of changes in signal parameters. The article reviews the works of other authors devoted to different ways of using ANNs for processing radio signals. Taking into account the information in the reviewed works, the research task was formed, which consists in developing an optimized ANN model for radio signal processing. Signals with amplitude modulation of many components (AMMC) were chosen to form training samples for ANN. The choice of modulation type is justified by greater energy efficiency compared to other widely used digital modulation types, such as quadrature amplitude modulation. Mathematic basis of AMMC signal generation is described. The process of finding the coordinates of three component 8-AMMC signal constellation is explained, the formation of signals in the time plane based on the found coordinates is explained as well as their discretization and the addition of white noise. An iterative algorithm for generating initial data for ANN based on the described ratios is proposed. The general structure of one-dimensional convolutional neural network is considered. Functions of individual neurons, connections between them, the formation of layers and the convolution operation are described mathematically. On the basis of the previously given ratios, a final display of the network was formed. Specific dimensions and activation functions for layers are selected. The use of convolutional layers is justified by time invariance. Based on the reviewed mathematical models, selected activation functions and dimensions, a neural model was formed. The process of validating the effectiveness of the formed neural model is described, which is based on comparing the symbolic error probabilities of the proposed and reference models at different signal-to-noise ratios. The validation results are presented. The advantages of the obtained model over the previously proposed purely recurrent model and the AMMC reference receiver are explained.

Integrating Graph Neural Network-Based Surrogate Modeling with Inverse Design for Granular Flows

Integrating Graph Neural Network-Based Surrogate Modeling with Inverse Design for Granular Flows

A digital twin model of the axial temperature field of a DC cable for millisecond calculations

The most important features of digital twin technology for transmission and transformation equipment are symbiotic evolution and state prediction. In constructing the digital twin model for DC cables, the transient and steady-state temperature fields need to be considered comprehensively in the modeling process to consider the multi-physical field coupling, mathematical model, operational data, and environmental conditions in specific cases, which makes it difficult to satisfy the real-time requirements of the digital twin. To solve this problem, in this paper, a digital twin technology architecture for DC cables is proposed, and a neural network learning model is constructed to minimize the latency due to the complexity of the model simulation. Moreover, an efficient digital twin model that is based on the model-driven approach is developed for the fast computation of the axial temperature field of DC cables. The use of the Sequence-to-Sequence residual neural network algorithm for the reduced-order multi-physics field coupling modeling reduces the computational time and ensures as much accuracy as possible up to the finite element model simulation. The simulation results show that the use of the digital twin model reduces the simulation time from 275 s to 0.56 s, and the relative error between the accuracy of the digital twin model and the finite element model for the axial temperature field of the DC cable is 0.46 %. Finally, verification of the reasonableness and feasibility of the proposed method is carried out via an experimental platform according to the standard of CIGRE TB496. In particular, the maximum value of the DC cable temperature is verified to have a small error compared with the result of the Sequence-to-Sequence calculation under specific working conditions.

A CNN Model for Physical Activity Recognition and Energy Expenditure Estimation from an Eyeglass-Mounted Wearable Sensor

Metabolic syndrome poses a significant health challenge worldwide, prompting the need for comprehensive strategies integrating physical activity monitoring and energy expenditure. Wearable sensor devices have been used both for energy intake and energy expenditure (EE) estimation. Traditionally, sensors are attached to the hip or wrist. The primary aim of this research is to investigate the use of an eyeglass-mounted wearable energy intake sensor (Automatic Ingestion Monitor v2, AIM-2) for simultaneous recognition of physical activity (PAR) and estimation of steady-state EE as compared to a traditional hip-worn device. Study data were collected from six participants performing six structured activities, with the reference EE measured using indirect calorimetry (COSMED K5) and reported as metabolic equivalents of tasks (METs). Next, a novel deep convolutional neural network-based multitasking model (Multitasking-CNN) was developed for PAR and EE estimation. The Multitasking-CNN was trained with a two-step progressive training approach for higher accuracy, where in the first step the model for PAR was trained, and in the second step the model was fine-tuned for EE estimation. Finally, the performance of Multitasking-CNN on AIM-2 attached to eyeglasses was compared to the ActiGraph GT9X (AG) attached to the right hip. On the AIM-2 data, Multitasking-CNN achieved a maximum of 95% testing accuracy of PAR, a minimum of 0.59 METs mean square error (MSE), and 11% mean absolute percentage error (MAPE) in EE estimation. Conversely, on AG data, the Multitasking-CNN model achieved a maximum of 82% testing accuracy in PAR, a minimum of 0.73 METs MSE, and 13% MAPE in EE estimation. These results suggest the feasibility of using an eyeglass-mounted sensor for both PAR and EE estimation.

Multi-Task Learning in Natural Language Processing: An Overview

Deep learning approaches have achieved great success in the field of Natural Language Processing (NLP). However, directly training deep neural models often suffer from overfitting and data scarcity problems that are pervasive in NLP tasks. In recent years, Multi-Task Learning (MTL), which can leverage useful information of related tasks to achieve simultaneous performance improvement on these tasks, has been used to handle these problems. In this paper, we give an overview of the use of MTL in NLP tasks. We first review MTL architectures used in NLP tasks and categorize them into four classes, including parallel architecture, hierarchical architecture, modular architecture, and generative adversarial architecture. Then we present optimization techniques on loss construction, gradient regularization, data sampling, and task scheduling to properly train a multi-task model. After presenting applications of MTL in a variety of NLP tasks, we introduce some benchmark datasets. Finally, we make a conclusion and discuss several possible research directions in this field.

Fault diagnosis of drone motors driven by current signal data with few samples

Multi rotor unmanned aerial vehicles (UAVs) are extensively utilized across various domains, and the motor constitutes a pivotal element in the UAV power system. The majority of UAV failures and crashes stem from motor malfunctions, underscoring the imperative need for comprehensive research on fault diagnosis in UAV motors to ensure the stable and reliable execution of flight tasks. This study focuses on quadrotor UAVs as the research subject and devises targeted fault simulation experiments based on the structural features and operational characteristics of the DC brushless motor used in quadrotor UAVs, specifically examining the stator, rotor, and bearings. To address challenges related to the UAV’s own loads, limited space for redundant parts, and the high cost and difficulty associated with installing sensors for traditional fault diagnostic signals such as vibration and temperature, this study opts to use current signals as a substitute. This approach resolves the issue of challenging data collection for UAVs and investigates a current signal based fault diagnosis method for UAV motors. Lastly, in response to the limited training samples available for fault data due to the UAV’s highly sensitive characteristics regarding the health status of its components and flight stability, traditional machine learning and deep learning methods encounter difficulties in identifying representative features with a small number of training samples, leading to the risk of overfitting and reduced model accuracy in fault diagnosis. To overcome this challenge, we propose a hybrid neural network fault diagnosis model that incorporates a width learning system and a convolutional neural network (CNN). The width learning system eliminates temporal characteristics from the original current signal, capturing more comprehensive and representative sample features in the width feature space. Subsequently, the CNN is employed for feature extraction and classification tasks. In empirical small sample fault diagnosis experiments using current signal data for UAV motors, our proposed model outperforms other models used for comparison.

Data–Physics Fusion-Driven Defect Predictions for Titanium Alloy Casing Using Neural Network

The quality of Ti alloy casing is crucial for the safe and stable operation of aero engines. However, the fluctuation of key process parameters during the investment casting process of titanium alloy casings has a significant influence on the volume and number of porosity defects, and this influence cannot be effectively suppressed at present. Therefore, this paper proposes a strategy to control the influence of process parameters on shrinkage volume and number. This study constructed multiple regression prediction models and neural network prediction models of porosity volume and number for a ZTC4 casing by simulating the gravity investment casting process. The results show that the multiple regression prediction model and neural network prediction model of shrinkage cavity total volume have an accuracy of over 99%. The accuracy of the neural network prediction model is higher than that of the multiple regression model, and the neural network model realizes the accurate prediction of shrinkage defect volume and defect number through pouring temperature, pouring time, and mold shell temperature. The sensitivity degree of casing defects to key process parameters, from high to low, is as follows: pouring temperature, pouring time, and mold temperature. Further optimizing the key process parameter window reduces the influence of process parameter fluctuation on the volume and number of porosity defects in casing castings. This study provides a reference for actual production control process parameters to reduce shrinkage cavity and loose defects.

A cross layer graphical neural network based convolutional neural network framework for image dehazing

The current version of imaging equipment cannot quickly and effectively make up for the reduction of visibility triggered by bad weather. Traditional strategies minimize hazy impacts by employing an image depth model and a physical model. Following experts, erroneous depth data reduces the efficacy of the dehazing algorithm. Dehazing methods based on CNN are imperfect to handle region which is bright or similar to atmospheric light and thus leads to oversaturation of pixels. These challenges can be addressed by proposing a novel model that incorporates the idea of a Graphical Neural Network. The amount of light coming from the atmosphere is estimated using normalization where the contrast of the image gets adjusted using Bias Contrast stretch Histogram Equalization. An enhanced Transmission map estimator is used to render the hazy scene. Finally, the cross-layer graphical neural network-based CNN model is applied to produce a haze-free image and eliminate the over-saturation of pixels. Extensive evaluation findings show that the proposed approach can significantly recuperate misty imagery, even if the images have a substantial amount of haze.

Hyper-Flophet: A neural Prophet-based model for traffic flow forecasting in transportation systems

Nowadays, an accurate and reliable traffic forecast is meaningful in making the right decisions for traffic management systems in vehicular environments. Nevertheless, traffic flow prediction is a significant challenge in Vehicular Ad Hoc Networks (VANETs) that has taken much attention. Therefore, in this paper, we propose a hybrid traffic prediction model based on Prophet model and Long Short-Term Memory neural network (LSTM), called Hyper-Flophet, to predict next traffic flow. Hyper-Flophet model adopts the traditional neural prophet model but with major parameter tuning. First, we propose an efficient algorithm for predicting the traffic flow trend then, we develop an interactive LSTM (I-LSTM) model for auto-regression components. After that, we implement a new future regressor component called network mobility and finally, we enhance the event and holiday component by introducing exponential growth term. Through simulations with real VANET data, we show that the proposed hybrid approach can achieve superior forecasting performance over other models.

Physics‐constrained symbolic model discovery for polyconvex incompressible hyperelastic materials

AbstractWe present a machine learning framework capable of consistently inferring mathematical expressions of hyperelastic energy functionals for incompressible materials from sparse experimental data and physical laws. To achieve this goal, we propose a polyconvex neural additive model (PNAM) that enables us to express the hyperelastic model in a learnable feature space while enforcing polyconvexity. An upshot of this feature space obtained via the PNAM is that (1) it is spanned by a set of univariate basis functions that can be re‐parametrized with a more complex mathematical form, and (2) the resultant elasticity model is guaranteed to fulfill the polyconvexity, which ensures that the acoustic tensor remains elliptic for any deformation. To further improve the interpretability, we use genetic programming to convert each univariate basis into a compact mathematical expression. The resultant multi‐variable mathematical models obtained from this proposed framework are not only more interpretable but are also proven to fulfill physical laws. By controlling the compactness of the learned symbolic form, the machine learning‐generated mathematical model also requires fewer arithmetic operations than its deep neural network counterparts during deployment. This latter attribute is crucial for scaling large‐scale simulations where the constitutive responses of every integration point must be updated within each incremental time step. We compare our proposed model discovery framework against other state‐of‐the‐art alternatives to assess the robustness and efficiency of the training algorithms and examine the trade‐off between interpretability, accuracy, and precision of the learned symbolic hyperelastic models obtained from different approaches. Our numerical results suggest that our approach extrapolates well outside the training data regime due to the precise incorporation of physics‐based knowledge.

Distributed and dynamical communication: a mechanism for flexible cortico-cortical interactions and its functional roles in visual attention

Perceptual and cognitive processing relies on flexible communication among cortical areas; however, the underlying neural mechanism remains unclear. Here we report a mechanism based on the realistic spatiotemporal dynamics of propagating wave patterns in neural population activity. Using a biophysically plausible, multiarea spiking neural circuit model, we demonstrate that these wave patterns, characterized by their rich and complex dynamics, can account for a wide variety of empirically observed neural processes. The coordinated interactions of these wave patterns give rise to distributed and dynamic communication (DDC) that enables flexible and rapid routing of neural activity across cortical areas. We elucidate how DDC unifies the previously proposed oscillation synchronization-based and subspace-based views of interareal communication, offering experimentally testable predictions that we validate through the analysis of Allen Institute Neuropixels data. Furthermore, we demonstrate that DDC can be effectively modulated during attention tasks through the interplay of neuromodulators and cortical feedback loops. This modulation process explains many neural effects of attention, underscoring the fundamental functional role of DDC in cognition.

Cyclic behavior of laminated bio-based connections with slotted-in steel plates: Genetic algorithm, deterministic neural network-based model parameter identification, and uncertainty quantification

To support more sustainable construction, this paper experimentally investigates the cyclic behavior of laminated timber (Laminated Veneer Lumber (LVL)) and glubam (Glue Laminated Bamboo) connections with slotted-in steel plates in terms of experimental test, numerical simulations and parameter identification. Experimental tests included eight different configurations: two materials (LVL and glubam), two bolt diameters (8 and 10 mm), and one or two bolts. Two different cyclic-loading protocols were applied for each type of connection: only tension and tension/compression. The observed behavior is then compared to a finite element model developed in OpenSeesPy, which takes into account factors such as sliding, contact, pinching, cyclic stiffness, and strength degradation. To identify the best set of parameters for the model, three different approaches are considered: genetic algorithm, fast deterministic neural network, and probabilistic Bayesian method. First, the model identification is carried out by means of a genetic algorithm-based optimization. The parameter-identification results are evaluated in terms of elastic stiffness, yielding point, and ductility. Next, a sensitivity analysis is performed to determine the significance of the parameters, and an innovative approach combining neural network and sensitivity analysis is proposed for fast and preliminary parameter identification. Then, probabilistic Bayesian identification is employed to calculate the posterior distribution of the model parameters identified and the confidence bounds of the estimated response. Finally, different model identification parameters are compared and suggestions for algorithm selection are provided.

Novel robust Elman neural network-based predictive models for bubble point oil formation volume factor and solution gas–oil ratio using experimental data

Novel robust Elman neural network-based predictive models for bubble point oil formation volume factor and solution gas–oil ratio using experimental data

A multiscale and multicriteria generative adversarial network to synthesize 1-dimensional turbulent fields

This article introduces a new neural network stochastic model to generate a 1-dimensional stochastic field with turbulent velocity statistics. Both the model architecture and training procedure ground on the Kolmogorov and Obukhov statistical theories of fully developed turbulence, so guaranteeing descriptions of (1) energy distribution, (2) energy cascade and (3) intermittency across scales in agreement with experimental observations. The model is a generative adversarial network (GAN) with multiple multiscale optimization criteria. First, we use three physics-based criteria: the variance, skewness and flatness of the increments of the generated field, that retrieve respectively the turbulent energy distribution, energy cascade and intermittency across scales. Second, the GAN criterion, based on reproducing statistical distributions, is used on segments of different length of the generated field. Furthermore, to mimic multiscale decompositions frequently used in turbulence’s studies, the model architecture is fully convolutional with kernel sizes varying along the multiple layers of the model. To train our model, we use turbulent velocity signals from grid turbulence at Modane wind tunnel.

Neuromorphic computing spiking neural network edge detection model for content based image retrieval

ABSTRACT In contemporary times, content-based image retrieval (CBIR) techniques have gained widespread acceptance as a means for end-users to discern and extract specific image content from vast repositories. However, it is noteworthy that a substantial majority of CBIR studies continue to rely on linear methodologies such as gradient-based and derivative-based edge detection techniques. This research explores the integration of bioinspired Spiking Neural Network (SNN) based edge detection within CBIR. We introduce an innovative, computationally efficient SNN-based approach designed explicitly for CBIR applications, outperforming existing SNN models by reducing computational overhead by 2.5 times. The proposed SNN-based edge detection approach is seamlessly incorporated into three distinct CBIR techniques, each employing conventional edge detection methodologies including Sobel, Canny, and image derivatives. Rigorous experimentation and evaluations are carried out utilizing the Corel-10k dataset and crop weed dataset, a widely recognized and frequently adopted benchmark dataset in the realm of image analysis. Importantly, our findings underscore the enhanced performance of CBIR methodologies integrating the proposed SNN-based edge detection approach, with an average increase in mean precision values exceeding 3%. This study conclusively demonstrated the utility of our proposed methodology in optimizing feature extraction, thereby establishing its pivotal role in advancing edge centric CBIR approaches.